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Abstract 


Psychological processes are difficult to be studied due to their complexity. The dynamic system approach 
shows itself as a good tool for psychology to deal with this complexity issue. We propose two fundamental 
contributions of the dynamic system approach to psychology and apply it in the study of achievement emotions, 
appraisal and cognitive achievement. Two hypotheses were investigated: 1) More than one correlation pattern 
between test achievement, appraisal and emotion will be found; 2) Test achievement, appraisal and emotion 
form a dynamic system which will be explained by a latent variable that is dependent on the previous state 
of the system. A sample of thirteen students from seventh to ninth grades performed an inductive reasoning 
test, appraised their achievement, and declared their emotional valences (from extreme positive to extreme 
negative). Each variable was measured in 20 different occasions. One correlation matrix of each individual 
was generated and seven qualitative profiles were identified. Then four different states of relations between the 
variables were identified through a hidden Markov model. The two hypotheses were not refuted. It's concluded 
that the dynamic system approach brings new possibilities to the study of psychological processes. 
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Introduction 


Understanding the dynamic of cognitive processes in psychology is one of the goals of the 
psychological science. However, the processes studied are too complex: they have a considerable 
quantity of components in a net of reciprocal causality (Schmittmann et al., 2013). Despite the dif- 
ficulty, there are new possibilities. We propose that the dynamic system approach can help psychol- 
ogy in this endeavour through two fundamental contributions. First, it defines complexity, which is 
a fundamental step. Accordingly to the dynamic system approach, one system is complex when: (1) 
the number of components interacts to define its own structure; (2) the relationship of the components 
is non-linear, (3) and is self-organized (Van Geert & Steenbeek, 2008). 

Learning any school content is a good example of the definition about complexity. Any learning 
always exceeds the input of teachers, colleagues, didactic materials, and so on, because the system 
has components that interact translating and transforming the content structure in function of the 
mechanisms of the own system (rule one). Moreover, the reciprocal influence of the components 
causes a non-linear dynamic (rule two) and the system progressively increases the level of the 
learning in a self-organized process (rule three). All these characteristics can be seen in the work of 
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Mitra, Tooley, Inamdar and Dixon (2003), where, even though not relying in the dynamic systems 
methodologies, they show a group of children from India that improved their English pronunciation 
by their own using a speech-to-text software engine. Without any human mediation, their improve- 
ment is a typical example of a self-organized process. 

Diminishing the complexity without losing the fundamental properties of the system is the 
second fundamental contribution of the dynamic system approach to psychology. According to Van 
Geert and Steenbeek (2005a) any study in psychology complies with the dynamic systems approach 
if the equation | 1s directly or indirectly present, since this is the primary equation of any dynamic 
system. 


Equation 1: yp41 = fQ%) 


The equation demonstrates that the state of the system is caused by its previous state. In other 
words, the value of y on a specific moment of time (t+1) is a function of its value on the previous 
moment (t). This equation contains the fundamental idea of a dynamical system and can be applied 
to the study of several constructs, not being confined to a specific psychological theory (Van Geert 
& Steenbeek, 2005a, p. 411). The main advantage is that despite the reduction of the complexity of 
the variable under investigation, it does not lead to any lost in its key properties when applying any 
model related to equation 1. Accordingly to the authors, there are a variety of models in consonance 
with this basic equation, as the Hidden Markov Model, simulation models, differential equation, and 
others. These statistical and mathematical methods can reduce the complexity without losing the 
fundamental properties of the complex system because they maintain the basic equation 1. 

On the context of the developmental psychology there are several studies that connect the dy- 
namic system approach to cognitive development. For example, Van Geert and Fischer (2009) and 
Van Geert and Steenbeek (2005b) employed dynamic systems to study the role of context-person 
interactions in the expression of cognitive abilities. Yan and Fischer (2002), by their turn, investigated 
the levels of cognitive abilities people showed in multiple contexts and scales of time. The view of 
humans and their psychological processes as dynamical systems is based on the idea that different 
components influence each other in a bidirectional (or reciprocal) way, creating a feedback loop that, 
in return, shapes their relation (Cramer et al., 2012a). This idea is worth not just in developmental 
psychology, but also in the personality research field. Cramer et al. (2012a), for example, showed 
evidences that personality traits emerged from the interactions between its components (thoughts, 
feelings and behaviors), just like flocking emerged from the local interactions between birds. The 
dynamic analysis presented by Cramer et al. (2012a) creates a whole new perspective of personality, 
since direct relations between indicators (e.g. personality items) are not just an expected character- 
istic, but the phenomenon under investigation. 

Concluding, we proposed two fundamental contributions of the dynamic system approach to 
psychology that structured their relation. The first is the capacity of the dynamic system approach 
to objectively define complexity and its properties. The second is the capacity to reduce the com- 
plexity of the object under investigation without losing its fundamental properties. Next, we will 
demonstrate the relation between dynamic system and psychology theory through the study of 
achievement emotions. 

















Test Achievement, Appraisal and Emotional Valence: a Dynamic System 





In the Control-Value theory of Reinhard Pekrun, achievement emotions are emotions associated 
with activities involving performance or outcomes (Pekrun & Sthepens, 2010). The Control-Value 
theory defines emotion as the relationship between affective, cognitive, motivational, expressive and 
physiological components, and seeks to understand its role in academic contexts (Pekrun, 2006). 
The author points out two main components of achievement emotions, control and value, both tight 
to people’s evaluation about their own achievements or outcomes (Pekrun, 2006). The first refers to 
the individual’s judgment about the control that he has over his performance in the activity, taking 
into account the influence of context, other people and himself. In other words, control refers to one’s 
judgment about how their actions affect their outcome. The second component addresses people’s 
judgment on the importance of the activity and the outcome. 
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Given control and value judgments, achievement emotions can be generated in three key mo- 
ments: before, during and after performing a task (Pekrun 2006; Pekrun & Sthepens, 2010). The 
theory holds that each of these moments creates different types of emotions. The first moment gen- 
erates prospective emotions, linked to a previous judgment of future performance in the task itself, 
whereas the second moment produces activity related emotions, and the third moment generates 
retrospective emotions, linked to the performance achieved in the task. 

The combination of control, value and the three judgment moments produces nine achievement 
emotions (Pekrun & Stephens, 2010): 1) Prospective emotions: hope, relief, anxiety and despair; 2) 
Activity emotions: satisfaction and boredom; 3) Retrospective emotions: pride, shame and anger. Such 
emotions generated before, during and after a task have a key role in mediating the performance of 
a person. They will be of fundamental importance for the definition of the attitude and behavior of 
the person in relation to the task, thereby regulating their own performance (Pekrun, 1992; Pekrun, 
2006). Thus, one’s judgment on a task causes the achievement emotions, which affects their perfor- 
mance on the task (Pekrun, 1992). At the same time, the performance achieved in a given task will 
generate new emotions that will influence the judgment on future tasks. Therefore, we infer that 
judgment (appraisal), emotions and performance influence each other 1n a reciprocal and non-linear 
way, generating a self-organization process, characterizing a dynamic system. 














Research Focus 


Considering the Control- Value theory, we assume that tests composed by cycles with levels of 
increasing difficulty will produce a dynamic system behavior between emotion, achievement and 
appraisal. To investigate our assumption we’ll use a testing design that incorporates four cycles. Each 
cycle is composed by five levels with increasing difficulty. When a cycle finishes, the next one begins 
with the easiest level. This process repeats until the end of the fourth cycle. Figure | shows this testing 
design. First, the person answers three items with difficulty level one (1-3 on the x-axis), then he/ 
she answers three items with difficulty level two (4-6 on the x-axis). The process goes on until the 
person answers the three most difficult items (level five). In this moment one cycle ends and the next 
cycle begins. People will be asked, after each group of three items, to judge their performance, 1.e. 
if they passed or not the group of items (appraisal), and to report their perceived emotional reaction 
to them (levels of retrospective emotion, from extreme negative to extreme positive). 
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Figure 1: Testing Design: Difficulty Level (Y-axis) by Items (X-axis). 





Two hypotheses will be investigated: 1) More than one correlation pattern between test achieve- 
ment, appraisal and emotion will be found; 2) Test achievement, appraisal and emotion form a 
dynamic system which is explained by a latent variable © that is dependent on the previous state of 
the system (see equation 2 below). 
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Equation 2: Yer1 = f(Oz) 


The present paper aims to investigate the dynamic relations between emotion, appraisal and cog- 
nitive achievement, by using a method that can assess the non-linear relation between the components, 
which are involved in a net of reciprocal causality. The paper follows the dynamic approach tradition 
also employed in the personality (Cramer et al., 2012a; Schmittmann et al., 2013) and developmental 
literature (Van Geert & Fischer, 2009; Van Geert & Steenbeek, 2005b; Yan & Fischer, 2002). 


Methodology of Research 


Sample of Research 


Thirteen students, seven male and six female, responded all items of the instruments used in 
the research. Four of them were in seventh grade, three in eighth grade, and six in the ninth grade. 
Mean age was 13.53 years and standard deviation was 1.05. All students were from a private school 
located in the city of Belo Horizonte, Minas Gerais, Brasil. 


Instrument and Procedures 
Inductive Reasoning Developmental Test (IRDT) 


The Inductive Reasoning Developmental Test (RTD) is a pencil-and-paper instrument de- 
signed to assess developmentally sequenced and hierarchically organized inductive reasoning. The 
sequence was constructed based on the Model of Hierarchical Complexity, and has eight items 
specifically designed to identify each stage, covering seven stages (from Pre-operational to Meta- 
systematic) in a total of 56 items. Each item is composed of four letters, or sequence of letters, with 
a specific rule (correct items), plus one letter or sequence with a different rule (exception). The task 
is to discover which letter or sequence is the exception. Golino and Gomes (2012) administered 
the IRDT to 1,193 Brazilian people (53% women, 47% men) from 6 to 86 years (M = 15.02, SD = 
12.30). The dichotomous Rasch Model was used, and pointed a separation reliability of 0.99 for the 
56 items and an infit mean square mean of 0.90 (SD = 0.23). The person separation reliability was 
0.80. The principal contrast showed that the raw variance explained by measures was 73.2%, and 
that the unexplained variance in the first contrast was 6.9%, suggesting the unidimensionality of the 
instrument. The items’ difficulties presented 7 clusters with gaps between them, as visually verified 
by the Wright map. The clusters were confirmed by the hidden markov model, which presented a 
solution with 7 classes (log Lik.= -26.28, df=62, AIC: 176.57, BIC: 302.14). In the current study 
only the first five difficulty levels were employed. The mean difficulty (Rasch score) of each level, 
its standard deviation, as well as the minimum and maximum difficulty for each level are presented 
in table 1. In the current study, only five levels of difficulty were employed. 

From the items of the Inductive Reasoning Developmental Test four booklet versions were 
created. Each booklet version has 60 items, forming 4 cycles. Each cycle has five groups of three 
items, each one representing a specific level of difficulty. So, the first 15 items of the booklet com- 
poses the first cycle: items one, two and three represents the first difficulty level; 1tems four, five, 
and six represents the second difficulty level, and so on, until items 13, 14 and 15 that represents the 
fifth difficulty level. The next 45 items compose the second, third and fourth cycle, organized with 
the same structure as cycle one. So, each booklet version 1s composed by four cycles (see Figure 
1). Each cycle has one item that 1s also present in another cycle of the same booklet. Repeating the 
same item twice along the booklets is a strategy that allows equating using Item Response Theory 
techniques, and may be useful in future studies employing the data available in the current paper. 
The difference between the booklet versions is the order of the four cycles, e.g., the first cycle of the 
version one is the fourth cycle of the version four. Table 1 shows one example of item from each of 
the five difficulty levels that composes a cycle, as well as the mean difficulty, standard deviation, 
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minimum and maximum difficulty per level (using logits as unit of measurement). Although table 1 
shows the mean difficulty of each level using the Rasch difficulty of the items, in the current study 
we are using the item’s raw score. The raw score is generated through the sum of right answers in 
each group of three items representing the difficulty levels in each cycle. Each group has a score that 
goes from 0 (participant failed all three items) to 3 (participant passed all three items). 



































































































































Table 1. Example of items of each difficulty level, mean, standard deviation, 
minimum and maximum difficulty (logits) for each level. 
Mean 
Difficulty EB aninleohiem difficulty Minimum! 
Level P (Standard Maximum 
Deviation) 
1 Level one : A ir A (| A | E (\ A j -6.64(0.33)  -7.18/-6.04 
| 
9 _ Level two Ww x K | S T| | P R | Y Z| : 459(0.25)  -5.02/-4.19 
—_—>Syy__-_=SSS__=a=__-_-__a=a_==_==_==SS===== 
3 Levelthree | E 1, K L ir J ie D M O 0.38(0.15) 0.14/0.64 
j H|/ P NVM L/I4G of of 
/ AY / A 
+ Lowtou Palefeiielelsl lel) slslelersie) 170 199188 
5 Levelfive |*8/"M]is mp e feel c AR AME 3.53(0.27)  3.24/4.05 









































Appraisal of Test Achievement and Emotional Valence 


Along with each group of three items (representing the difficulty levels) there is an achieve- 
ment appraisal scale. The participants answer how many items they believe to have passed, from 
three to zero items of that group. They are asked to do it for each group of three items. The score 
for each difficulty group goes from 0 (they believe to have failed all three items) to 3 (they believe 
to have passed all three items). Together with the appraisal scale, the participants mark one out of 
five emotions that represent different emotional valences: from a very negative (score 1) to a very 
positive (score 5). 








Data Analysis 


The data were collected in March of 2011. Each participant answered only one booklet version 
in a unique moment. Different participants responded different booklet versions. After the ending of 
one cycle of the booklet, it was given one minute of pause before the beginning of the next cycle. 

The answers of each participant generate 20 raw scores of test achievement: Each group of 
three items produces a raw score of zero, one, two or three points (respondent passed all three items). 
Twenty raw scores of emotional valence and achievement appraisal were also produced. 
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One polychoric matrix was generated by person, aiming the investigation of the profiles of 
correlation between test achievement, appraisal and emotional valence. After estimating the poly- 
choric correlation, a Hidden Markov Model (Baum & Petrie, 1966) was applied to investigate the 
states involved in the dynamic of the test achievement, appraisal, and emotional valence. In order 
to apply the Hidden Markov Model, the depmixS4 package (Visser & Speekenbrink, 2010) of the 
R software was used. Hidden Markov Model (HMM) 1s a probabilistic model that specifies a finite 
set of hidden (or latent) states (or classes with transition probabilities) that causes an observable 
outcome. The HMM 1s based on two assumptions: 1) the current state depends only on the previous 
state (first-order Markov Process), and 2) observable outcomes are dependent only on the current 
state, at time t. Figure 2 below illustrates an HMM: 


A 
Markov Process (S))—+(s) 








A 






Cea 
———SSEESS 






5 B B 
Observations/Outcomes ('),, O; (> “ies Or) 
Figure 2: Markov Process. 





Where S’ represents states sequence from 0 to T-1, A represents state transition probabilities, 
B observation/outcome matrix probabilities and O. observation/outcome sequence from 0 to T-1. 
Transition probabilities between states are assumed to follow first-order Markov process, 1.e. state 
at current time depend on the previous state (Visser & Speekenbrink, 2010). Every state has a prob- 
ability of remaining unchangeable, and a probability of transiting for any other state (see figure 3). 













P¢transition 1 to 2) 
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Figure 3: Transition between states. 


This particular characteristic of the HMM 1s interesting to our investigation since the first hy- 
pothesis states that different patterns of correlation between cognitive achievement, appraisal and 
emotions will be found in our sample. So, the use of HMM allows the identification of each state 
that emerges from the interactions between achievement, appraisal and emotions. For example, state 
S, may represent a state in which the person presents high probability of getting a score of zero in 
the cognitive test, a high probability of judging the cognitive achievement as low and a high prob- 
ability of experiencing very negative emotions. Continuing the example, state S, may represent a 
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state in which the person presents high probability of getting a score of three in the cognitive test, a 
high probability of judging the cognitive achievement as high and a high probability of experienc- 
ing positive very emotions. Furthermore, the HMM allows the calculation of the probabilities of 
changing from state S, to state S.. 

In sum, an HMM has two main parts: states’ measurement model and transition between states. 
States are the construct under investigation (in our case it is the relation between test achievement, 
appraisal and emotion), and transition characterizes the dynamics between states over time (Visser, 
Raijmakers & Van der Maas, 2009). A latent variable explains the dependencies between each state 
of dynamic system and its previous state. Eight models were estimated, from 1 to 8 states. Each 
state represents a different relation between test achievement, appraisal and emotional valence. The 
existence of more than one state indicates distinct relations between the components of the system. 
In order to choose the best model, two indexes were employed: Akaike’s Information Criterion (AIC; 
Akaike, 1973) and Bayesian Information Criterion (BIC; Schwarz, 1978). 

Since the depmixS4 package uses the expectation-maximization (EM) algorithm to maximize 
the log-likelihood, the AIC and BIC values can range due to random initialization of this algorithm. 
In this case, several interactions are necessary to estimate the global minimum of the AIC and BIC, 
instead of the local minimum (Haughton, Legrand, & Woolford, 2009). So, two hundred models were 
calculated for the estimation of the AIC and BIC for each number of states, from | to 8. 

















Results of Research and Discussion 


We will present in the same section results and discussion due to the necessity to describe the 
results along with the interpretation of the qualitative profiles and the states identified through the 
Hidden Markov Model. Seven qualitative profiles were identified, indicating different patterns of 
correlations between the variables of the study. These profiles probably imply different functional 
aspects of the system. Next, we describe each profile, presented in the Table 2. 


Table 2. The Seven Qualitative Profiles: correlation matrixes and graphics. 
Profile 1 - Five participants ; 
Valence Achievement — Appraisal 4 
Valence 1.00 O:11 0.09 4 
Achievement 0.63 1.00 0.19 9 
Appraisal 0.79 0.72 1.00 ; ee oe a ee 


Profile 2 - Two participants 


6 
Valence Achievement Appraisal 3 *eeeeeececeeoeoceeeceeeeeeeeeeee 
Valence 1.00 nv a ay a toe na OP om ae 
Achievement nv 1.00 0.15 o 
Appraisal nv 0.60 1.00 3 11 13 15 17 19 


Profile 3 - One participant 


6 
Valence Achievement Appraisal i 
3 ” eet oe Yn 
Valence 1.00 2 . f \ / / 
1 egececicezecdpncccente 
Achievement 0.37 1.00 9 is = = 


2 Jt 13 13 17 J9 





Appraisal 0.25 0.62 1.00 
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Profile 4 - Two participants 


6 
Valence Achievement — Appraisal 4 CS eee 
Valence 1.00 0.00 nv + 
Achievement 0.00 1.00 0.00 a 
Appraisal nv 0.00 1.00 


Profile 5 - One participant 


Valence Achievement Appraisal 


Valence 1.00 
Achievement 0.13 1.00 
11 13 15 i/ 19 
Appraisal 0.64 0.12 1.00 


Profile 6 - One participant 


Valence Achievement Appraisal 


Valence 1.00 
Achievement 0.50 1.00 
11 13 15 1/7 19 
Appraisal nv nv 1.00 


Profile 7 - One participant 


Valence Achievement Appraisal 


ee a Ty et og Gee ee el si, lel 
i 





Valence 1.00 
Achievement 0.13 1.00 
9 11 1315 1/ 19 
Appraisal -0.08 0.36 1.00 


nv = No variation; Dotted line = Emotional Valence; Dashed line = Appraisal; Grey line = Cognitive Achievement. 
The correlation matrix of the profiles, with more than one participant each, shows the mean values below the diagonal and stand- 
ard deviation upper the diagonal 





In profile one, which was found in five participants, there were relatively moderate correlations 
between all the variables, indicating that the appraisal was reasonably connected to emotional valence 
(0.79) and at least reasonably linked to test achievement (0.72). Achievement and emotional valence 
were also moderately related (0.63). People with this profile are relatively good at assessing their perfor- 
mance, and the emotional valence has a function of evaluation somehow similar to the appraisal ability. 
If their performance becomes poor in the difficult items they will perceive this situation and judge their 
achievement as a poor one. At the same time they will feel a certain discomfort and displeasure. When 
the items become easier and the person passes them all, he/she will perceive this situation and judge 
to have passed all items. They will also report more comfort and pleasure compared with the previous 
situation. In profile one the appraisal can be thought as a “cold” evaluative ability, while the emotional 
valence can be thought as a “hot” evaluative ability of the performance, making an analogy with the 
cold and hot executive functions of neuropsychology (Metcalfe & Mischel, 1999). 

Profile two had two participants. In this profile, there were a moderate correlation (0.60) between 
appraisal and test achievement and an absence of variation in the emotional valence, indicating that 
these participants only show a “cold” evaluative function of the performance. The “hot” evaluative 
function did not appear in this profile. Table 2 shows a graphic of one person that presents only the 
maximum positive emotional valence, independently of his/her achievement or his/her appraisal. It is 
possible that emotion, in this case, works as a protective strategy, since a strong and rigid emotional 
valence would protect against bad feelings and displeasures in the moments of low achievement. But 
it is also possible that this characteristic would reflect a dysfunctional way of reacting to difficulty. 
Both possibilities need to be investigated in future studies. 
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Profile three, found in one participant, presented moderate correlation between achievement 
and appraisal (0.62), but showed weak correlations between emotional valence and appraisal (0.25), 
and between emotional valence and test achievement (0.37). These characteristics indicate a person 
that is moderately good in judging his/her achievement. However, the “cold” and “hot” evaluative 
functions of the performance have a weak relationship, possibly indicating a low communication 
between these functions. This low communication would be thought as a gap between the rational 
(“cold’’) and the intuitive (“hot’’) evaluation, which would be dysfunctional. In Table 2, the person 
with the third profile showed a very positive emotional valence when at the beginning of the test. 
However when he/she started to fail the items, he/she strongly dropped out the emotional valence 
to a very negative one, and remained in this condition throughout the whole test. In this case, the 
impact of the first failed items probably was potentially damaging and the emotional valence lost, at 
least in part, the capability of reflecting the test achievement. The previous interpretative comments 
are speculative and need to be investigated in future studies. 

Profile four was found in two participants and can be thought as dysfunctional because there was 
no correlation between the three variables. Appraisal was completely unattached to test achievement 
and to emotional valence. There was a disintegration or non-integration of the system, indicating an 
independency of the components. 

Profile five was found in one participant and 1s similar to profile one because both had a moder- 
ate correlation between appraisal and emotional valence, indicating that the “cold” and “hot” func- 
tion are connected. However, both appraisal and emotional valence showed a very weak correlation 
with test achievement (0.12 and 0.13, respectively), indicating that a participant with profile five is 
a bad judge. The major difference between profile one and profile five seems to be that the first is a 
reasonably good judge while the second is a bad judge. 

Profile six was found in one participant and had a dysfunctional characteristic because the ap- 
praisal does not vary in function of the achievement. However, the emotional valence had a moderate 
correlation with the test achievement, indicating that the “hot” component composes the evaluative 
function of the performance, while the “cold” component showed a disarticulation with the other 
two components of the system. 

Finally, profile seven, found in one participant, had a weak correlation between appraisal and 
test achievement and a very weak correlation between emotional valence and appraisal, as well as 
between emotional valence and test achievement. This condition is relatively similar to profile four. 
It also indicates a gap between the “cold” and “hot” evaluative functions. 

After the presentation of the qualitative profiles, the four states found using the Hidden Markov 
Model will be presented. Eight models were compared. The model number one represents the pres- 
ence of only one state of the system, while model two represents the presence of two states, and so 
on. Table 3 presents the logs of the models, their degree of freedom, as well as the AIC and BIC 
values. The BIC criterion points the fourth model as the best one (BIC = 1675.66), while the AIC 
criterion points the sixth model as the one presenting a better data fit (AIC = 1427.48). Considering 
that BIC is more parsimonious than AIC, the fourth model was chosen. 























Table 3. The Seven Qualitative Profiles: correlation matrixes and graphics. 
Models log df AIC BIC 
1 -912.02 10 1844.03 1879.64 
2 -817.01 23 1680.03 1761.93 
3 -138.57 38 1553.14 1688.44 
4 -684.91 59 1479.83 1675.66 
S) -642.42 74 1432.84 1695.33 
6 -618.74 95 1427.48 1765.75 
ig -598.84 118 1433.69 1853.85 
8 -581.10 143 1448.19 1957.37 


log = Loglikelihood; df = Degree of Freedom; AIC = Akaike’s Information Criterion; BIC = Bayesian Infor- 


mation Criterion 


OF PSYCHOLOGY 
IN THE 21* CENTURY 


Cristiano M. A. GOMES, Hudson F. GOLINO, Bianca C. G. COSTA. Dynamic System Approach in Psychology: Proposition and Application in 
the Study of Emotion, Appraisal and Cognitive Achievement 





The four states model represents qualitative processes found by a quantitative method (Hidden 
Markov Model). The measurement model for each of the states shows distinct score probabilities 
for each component of the system (see table 4). 

A person in the state one has a probability of 45% to declare a very negative emotional valence 
(score 1) and 35% to declare a neutral emotional valence (score 3). There is 16% of probability to 
inform a negative emotional valence (score 2), a 4% of probability to report a positive emotional 
valence (score 4), and a very low probability (approximately zero) of score 5 (very positive valence). 
However, the 16%, 4% and almost 0% are below the chance probability in the scale of five points, 
where the participant have 20% of chance to randomly choose any of the five options. In this case, 
only the very negative emotional valence and the neutral emotional valence reached a value greater 
than chance and will be considered in state’s one interpretation. State one shows a considerable 
probability of someone to report neutral or negative feelings. There is a major probability that the 
test achievement of a person in this state would be low, because there is 67% of probability to fail all 
the three items of an item group, and 25% of probability to pass only one item. A person in this state 
probably judges to have failed all three items (probability = 63%; the only value that is greater than 
chance). In sum, state one represents a moment in the dynamic system that a participant probably 
fails all items, or passes only one in the group of three items, appraisals to have failed all items, and 
experiences neutral valence or bad feelings and displeasure. There is in state one a good connection 
between failing the items, judging as a poor performance and feeling bad about it. 








Table 4. The Four States and the Probability of the Score Categories in Test 
Achievement, Appraisal, and Emotional Valence. 


State aca Scores sum 
1 2 3 é 5 
Valence 0.45 0.16 0:39 0.04 0.00 1.00 
State 1 Achievement 0.67 0.25 0.08 0.00 1.00 
Appraisal 0.63 0.14 0.16 0.07 1.00 
Valence 0.00 0.00 0.00 0.00 1.00 1.00 
State 2 Achievement 023 0.19 0.06 0.52 1.00 
Appraisal 0.00 0.02 0.04 0.94 1.00 
Valence 0.00 0.00 0.69 0.31 0.00 1.00 
State 3 Achievement 0.18 0.05 0.12 0.66 1.00 
Appraisal 0.00 0.00 0.04 0.96 1.00 
Valence 0.84 0.14 0.00 0.00 0.02 1.00 
State 4 Achievement 0.41 0.21 0.06 0.33 1.00 
Appraisal 0.21 0.00 0.00 0.79 1.00 


Score meaning: 

Valence: 1 —- Very negative emotional reaction; 2 - Negative emotional reaction; 3 — Neutral emotional reaction; 4 — Positive emo- 
tional reaction; 5 — Very positive emotional reaction. 

Achievement: 1 - No right answers; 2 - One right answer; 3 —- Two right answers; 4 — Three right answers. 

Appraisal: 1 - Participant reports his/her achievement on the test as having no right answers; 2 — Participant reports his/her 
achievement on the test as having only one right answer; 3 - Participant reports his/her achievement on the test as having two 
right answers; 4 - Participant reports his/her achievement on the test as having three right answers. 








State three represents the opposite of state one, so it will be described before state two. The person 
who’s in state three, shows a neutral or a positive emotional valence (69% and 31%, respectively), 
tends to passes all three items of a group (66%) and tends to strongly judge to have passed all items 
(96%). Concluding, state three represents a tendency to pass all items, appraising to have passed all 
items and feeling neutral or positive emotions. Concluding, state three represents a tendency to pass 
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all items, appraising to have passed all items and feeling neutral or positive emotions. In this state 
there is an overestimation of the cold evaluation, the person has 96% of chance to evaluate having 
passed all items whereas the chance of actually having passed them is of 66%. 

State two is interesting because there is almost 100% of probability that someone in this state 
feels a strong positive emotional valence. There 1s a powerful pleasure and positive feelings involved 
in this case. The only probability greater than chance in test achievement is the person passes all 
items (52%). Also, the person in state two has a very high likelihood of judging to have passed all 
items (94%). State two represents a rigid and very positive emotional reaction, with a pattern of high 
achievement (52%) and an appraisal that overestimates this achievement pattern. 

State four is almost the opposite of the state two, but not entirely. There is a very negative emo- 
tional valence (84%) in this state, which 1s the opposite of state two. However, the test achievement 
is different. People in this state can fail all items (41%) or pass all items (33%) of a group of three 
items. In this state the relatively similar probability in given all wrong or all right answers to the items 
is connected to a very negative feeling. Finally, people in this state tend to judge that they passed all 
items (79%) much more than the probability of really passing them (33%), indicating a relatively 
bad precision in the appraisal. Concluding, state four represents a very negative emotional valence, 
a similar probability to fail or to pass all items and a tendency to overestimate the performance. 

Concerning the quality of the appraisal, in state one a good judgment 1s shown, since the appraisal 
of achievement is similar to the observed achievement. In state two and three a moderate judgment 
is present, since the pattern of achievement is high but there’s a considerable part of chance (48%) to 
give none, one or two right answers that is underestimated. State four shows a poor judgment, because 
there is a bimodal chance of failing all items or passing all items and the appraisal overestimates the 
probability of high achievement and underestimates the probability of low achievement. 

The results also show state’s transition probabilities (see table 5). State one is the less stable, 
presenting 54% of probability of not changing into any other state. However, there is a probability 
of 13% of changing into state two and a probability of 27% of changing into state three. State 
one also has a probability of 6% of changing to the forth state. State two has a strong probability 
to stay the same (83%). There is a probability of 11% of changing into state one, a probability of 
6% of changing into state three, with almost 0% chance of changing into state four. State three 
also has a strong probability to stay the same (80%), with a probability of 19% of changing into 
state one, a chance of 1% of changing to state two, and almost 0% chance of changing into state 
four. State four is the most stable, presenting 94% probability of staying the same, with a small 
probability of changing into state three (6%), with almost 0% chance of changing both to state 
one or state two. 


Table 5. Transition probabilities between the four states. 
State 1 State 2 State 3 State 4 
State 1 0.54 O11 0.19 0.00 
State 2 0.13 0.83 0.01 0.00 
State 3 0.27 0.06 0.80 0.06 
State 4 0.06 0.00 0.00 0.94 
Sum 1.00 1.00 1.00 1.00 


In sum, state one is relatively fluid because it has a 46% chance of changing to another state. 
It is more likely that state one (low achievement, neutral or negative emotions and a tendency to 
correctly judge the performance) transforms into state three (high achievement, neutral or positive 
emotions and a tendency to moderately judge the performance), then to any other state. This tendency 
is reciprocal, i.e. it is more likely that state three transforms into state one than to any other state. 
State two, state three and state four are more inflexible since they have a probability of, at least, 830% 
of staying the same. State four is the most rigid. If changing, state two is more likely to transform 
into state one, while state four is more likely to transform into state three. State one is the only one 
that has at least 5% of probability to transform into all the other states. 
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Conclusions 


The present study applies the dynamic system approach to investigate the reciprocal relation 
between cognitive performance, achievement appraisal and self-reported emotional reactions. Em- 
ploying a specific test design, with four cycles of items with different levels of increasing difficulty, 
we presented two hypotheses: 1) More than one correlation pattern between test achievement, ap- 
praisal and emotion will be found and 2) test achievement, appraisal and emotional valence form 
a dynamic system that is explained by a latent variable that depends on the previous state of the 
system (see figure 2). This latent variable explains the dependency relationship between the observ- 
able variables (i.e. between achievement, appraisal and emotions). So, an observable relation (O,) 
between achievement, appraisal and emotions of time 7’, are explained by the state S,. By its turn, 
S, is dependent on the previous state S, of time 7. State S, also explains the observable relation 
O,. The results showed seven qualitative distinct patterns of correlation between the three variables 
under investigation as well as a four-state Hidden Markov Model. Both the correlation profiles and 
the four states model was presented and discussed in the previous section. However, some highlights 
will be made in the next paragraphs. 

We discover that there is a good probability that each state remains unchangeable. However, 
improving the probability of a high cognitive performance and the probability of judging this per- 
formance as good (giving right answers to the three items) may lead to positive emotional reactions, 
as verified by the probability of changing from state | or 4 to state 3. On the other hand, decreasing 
the probability of a high cognitive performance and the probability of judging this performance as 
good may lead to negative emotional reactions, as verified by the probability of changing from state 
2 or 3 to state 1. Both examples, whose interpretation focuses on the idea that improving cognitive 
performance may leads to positive emotional reaction, and worsening cognitive performance may 
leads to negative emotional reaction, is just one way to address the matter. The other ways are rep- 
resented by three ideas. 

First, that increasing the probability of experiencing positive emotions may increase the prob- 
ability of having a high cognitive performance and the probability of judging this performance as a 
good one (going from state | to state 2 or 3). Second, that increasing the probability of experiencing 
negative emotions may decrease the chance of a high cognitive performance, improve the chance 
of a poor performance and diminish the probability of judging the performance as good (going 
from state 3 to 4). And third, that decreasing the probability of experiencing positive emotions and 
increasing the chance of expressing negative emotions may increase the probability of a low cogni- 
tive performance and the chance of judging this performance as a poor one. 

A question someone may ask is: which interpretation 1s correct: 1) changes in cognitive per- 
formance impact emotional reactions, or 2) changes in the emotional reactions impact cognitive 
performance? The answer is: probably both are right! Cognitive performance and emotions walk in 
the same direction when there is a moderately good judgment of the performance, i.e. people tend 
to give three correct answers and to judge their answers as correct or fail the items and judge their 
answers to be wrong. Both statements are true: cognitive performance influence emotional reac- 
tions and emotional reactions influence cognitive performance. Achievement appraisal, cognitive 
performance and emotional reactions form a complex dynamic system. They influence each other in 
a bidirectional way, creating a feedback loop that shapes their relation. This bidirectional influence 
is also reported in the personality literature (Cramer et al., 2012a; Cramer et al., 2012b). 

The relation between emotions and intellectual achievement has been described before, but 
without employing a dynamical system approach (Pekrun, 2006; Pekrun & Sthepens, 2010). If cogni- 
tive performance, emotions and appraisal are studied using any model that complies with the basic 
equation |, presented in the introduction, will be possible to discover the net of reciprocal causality 
between them. And that is what we did in the current study. The application of the dynamical system 
approached allowed discovering that different profiles of correlation between cognitive performance, 
emotions and appraisal form four different states. Furthermore, we discovered that these states 
are stable, but when analyzing their transition probabilities, we verified a pattern indicating that 
changing the cognitive performance may leads to changes in emotional reaction and that changing 
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emotional reactions may leads to changes in cognitive performance, provided that performance is 
well appraised. 

Before the application of dynamic models in the current study, or in the above mentioned 
personality discussions (Cramer et al., 2012a; Cramer et al., 2012b), van Geert and Fischer (2009), 
Van Geert and Steenbeek (2005b) and Yan and Fischer (2002) applied it in studies of developmental 
psychology. This approach brings two main contributions to psychology: 1) it defines a complex 
system as a system in which the components interacts in a non-linear and self-organized way to de- 
fine the owner structure; and 2) it allows diminishing the complexity without losing the fundamental 
properties of the system. Both contributions are illustrated in the present paper, with the results of 
the dynamic system formed by cognitive performance, achievement appraisal and emotions. Future 
studies should employ a larger sample in order to create more stable correlation matrixes between 
the variables under investigation. 
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